CSV & text files - Python for climatology, oceanograpy and atmospheric science

CSV & text files

pandas IO tools

IO tools (text, CSV, HDF5, …)

https://pandas.pydata.org/pandas-docs/stable/user_guide/io.html#csv-text-files

Importing data with genfromtxt

https://docs.scipy.org/doc/numpy/user/basics.io.genfromtxt.html

Iterate over lines from multiple input streams

multiprocessing

MetPy Mondays`#126 - Queue with Multiprocessing : Unidata Developer's Blog

writing data to a sigle file

https://www.unidata.ucar.edu/blogs/developer/entry/metpy-mondays-126-queue-with